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ABSTRACT 

Five groups of college students, each of vhich had 
undergone a different high school biology experience, were tested 
with the Biological Sciences Curriculum Study (BSCS) Conprehensive 
Final Examination to obtain data on the lasting effects of the BSCS 
biology courses. The analysis of variance approach indicated highly 
significant differences among the five groups. Hovever, examination 
of the five means shovs that the differences are not great enough to 
have clear educational meaning. The predicted scores raise questions 
about the effectiveness of either the BSCS courses, the BSCS 
examination, or both. (Author) 
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Introduction 

The paucity of curriculum studies which evaluate the long- 
term effects of science course^'^ ■ has long been bemoaned by science 
educators. During the I96O-7O decade, the combination of experi- 
mental federally-supported secondary school science curricula 
and college entrance populations, constituting a large percentage 
of recent high school graduates, offered an opportunity to make 
an analysis of long term effects. The present study is an effort 
to use this opportunity for longitudinal data collection to exam- 
ine the question: Is there a difference in Biological Sciences 
Curriculum Study (BSCS) biological knowledge between students who 
have taken BSCS biology courses and those viho have taken a tradi- 
tional biology course when a retention test is given two or three 
years after they complete the course? Further, is there any 
appreciable difference in BSCS biological knowledge between stu- 
dents who have had "no'* biology and those who have had biology-- 
either BSCS or traditional? 
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Several previous studies had compared immediate course-end 

outcomes of BSCS versions with those of traditional courses. 

One of the most detailed was carried out by the BSCS itself and 

1 

reported by Wallace. 

^ Wallace, Wimburn L. ''The BSCS I96I-62 Evaluation Program— a 
Statistical Report." BSCS Newsletter , 'September 1963f 22-24. 

It was found that BSCS groups outperformed the traditional control 

groups by three points on the BSCS Comprehensive Final Examination. 

2 

Lisonbee and Fullerton compared low, middle, and high ability 
2 

Lisonbee, Lorenzo, and F\;llerton, Bill J. "The Comparative 
Effect of BSCS and Traditional Biology on Student Achievement." 
School Science and Mathematics , 64: 4-12; 196^^. 

subgroups from traditional and BSCS courses and found statistically 
significant differences only for the middle ability groups on the 
BSCS Comprehensive Final. Using two tests that were non-BSCS in 
their objectives. Lance compared students using the Green Version 

3 

Lance, Mary Louise. "A Comparison of Gains in Achievement 
Made by Students of BSCS High School Biology and Students of a 
Conventional Course in Biology." Dissertation Abstracts , 25 s 
2814; 19&^. 



of the BSCS course with students in a traditional course. No 

significant difference was found between achievement gains of the 
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BSCS and the traditional groups. In a similar study, Lewis 



""jewiSf William A, ''An Evaluation .of Four Selected Approaches 
to Teaching High School Biology, Dissertation Abstracts ^ 2?: 
1689-A; 1966, 

also found no significant difference between the BSCS and the 
traditional groups. Findings for these studies, however , were 
based on an end-of-the-course examination. 

Procedures 

In January of I968 the BSCS Comprehensive Final Examination, 
Forms J and K, was given to 972 Michigan State University students 
who were about to start the second term of a three-term sequence 
in a required general education science course. The first term 
of their science course covered physical science topics only. 
Most students were freshmen who had taken a high school biology 
course in the 9th or 10th grade in the 1963-6^ or 196^-65 school 
years. Some had taken biology as high school upperclassmon. The 

great majority of these students were non-science majors. 

Before being tested, the students were asked to indicate 
whether they had taken a BSCS course, another type of biology 
course, or no biology course at all. Their memories were stimu- 
lated by projecting a colored slide of the three BSCS textbooks. 
Because conflicting, incomplete, or unclassif iable information was 
supplied by some of the 97^ students tested, only 7^7 usable test 
scores were obtained. The test results for these 7^7 students 



were analyzed and the performance of the separate groups — based 
on their high school biology experience — were compared. 

Results - Test Analysis 

Since two "comparable'* formSf J and of the BSCS Compre- 
hensive Final Examination were used, student performance on each 
form was analyzed to see if the forms yielaed comparable scores. 
If there were widespread differences in performance on the twc 
forms, separate analysis (one for students who took Form J and a 
second for students who took Form K) would he necessary. 

Table I shows the test statistics for the two forms of the 

examination, 

TABLE I 

Test Statistics on Forms J and K of the BSCS 
Comprehensive Final Examination 



Type of Data Form J Form K 

Number Taking 386 361 

Range 5-^-;l 12-39 

Mean 2^.1 2^^.0 

SD 5.15 ^.88 

Average Item Difficulty 52 52 

Average Item Discrimination 2^ 2^ 

Kuder Richardson Formula 20 

Reliability Coefficient .60 ' ,60 

Standard Error of Measurement 3,26 3. 12 
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As indicated above, 386 students took Form J and 3^1, Form K. 
Student scores ranged from 5 to ^1 on Form J and from 12 to 39 on 
Form K. The standard deviations reflected these differevices and 
were 5.2 and ^4^.9 respectively. 

The average item difficulty— the percentage of the total 
group marking a wrong answer— was the same (52) for each form. 
The average item discrimination reflecting, the difference between 
the percentage of the "upper" group marking the right answer and 
the percentage of the "lower" group marking the right answer^ was 
the same for each form but was atypically low for a standardized 
test of this kind. The Kuder Richardson Formula 20 reliability 
was .60 for each form and reflects an unusually low degree of 
internal consistency in the examination as used in this study. 
Finally, the standard error of measurement reflecting the amount 
of error in an individual's test score was 3»26 for Form J and 
3.12 .for Form K. Since the test dat:^ indicated that the forms 
were operating almost identically ^ it was decided to combine their 
results • 

However^ to explore the low internal consistency, the Kuder 
Richardson Formula 20 reliability was calculated for each high 

school biology experience group for Form J. Table II reports 
these findings. 
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TABLE II 

Kuder Richardson Formula 20 Reliability Coefficients 
Calculated on Five Groups Taking Form J of the BSCS 
Comprehensive Final Examination 





Group 






r 


I 


BSCS Green 


21 




. 66 


II 


BSCS Blue 


^6 




.71 


III 


BSCS Yellow 


62 




.69 




Other H.S. Biology 


23? 




.52 


V 


No H.S. Biology 


20 




.10 


the 


The reliability coefficients 
.60 reliability index reported 


for these s 
earlier. 


,ub~groups support 
Slightly higher 





reliabilities were obtained for the BSCS sub-groups. 

Results - Group Performance 
Five groups of students were identified. Three groups had 
taken courses built around the three BSCS versions (Green, Blue, 
and Yellow), The fourth group consisted of students who hiad 
biology courses other than a BSCS version, and the fifth group 
was composed of students who indicated that they had no biology 
in High school. Table III shows the number, mean score, and 
standard deviation for the five groups. 



TABLE III 



Mean Scores and Standard Deviation on the BSCS 
Comprehensive for Five High School Biology Groups 





Group 


N 


Mean 


SD 


I 


BSCS Green 


ko 


24.0 


5.5 


II 


BSCS Blue 


80 


26.5 


5.5 


III 


BSCS Yellow 


106 


24.9 


5.5 


IV 


Other H,S. Biology 


485 


23.7 


4.7 


V 


No H.3. Biology 




21.4 


4.1 




Total 


7^7 ■ 







As indicated, test data was complete on 7^7 students; 226 of 
these students had some form of BSCS program. Another ^85 had 
"other" biology in high school and 36 had "no" high school biology. 
The average scores made on the examination ranged from 21 for 
the "no" biology group to 26.5 t.he students who experienced 
the Blue BSCS version. 

To obtain an index of the relationship between group meniter- 
ship and test scores a regression equation according to the method 
of Bottenberg and Ward^ was constructed* Score made on the BSCS 

^ Bottenberg, Robert A. and Ward, Joe E, Applied Multiple 
Linear Rep:ression , AD 413 i28. Clearinghouse for Federal Scientific 
and Technical Information, Springfield, Virginia: I963. 

The same method is discussed in: Kelly, F.J., Beggs, D.L., and 
McNeil, K.A. Multiple Regression Approach ? Research Design in the 
Behavioral Sciences . Carbondale: Southern Illinois University 
Press, 1969. 



examination was predicted from knowledge of the student's group 
membership. The five variables used to predict the examination 
scores for the 7^1-? students were: 

Variable Description 

1 A binary variable reflecting the student's having 
experienced the Green BSCS version 

2 A binary variable reflecting the student •s having 
experienced the Blue BSCS version 

3 A binary variable reflecting the student's having 
experienced the Yellow BSCS version 

4 A binary variable reflecting the student's having 
experienced ••other**' biology course work 

5 A binary variable reflecting the student's having 
had "no.'* biology course work 

When the five variables listed above wer^? used to predict 
examination score, the resulting multiple correlation coefficient 
was ,22. That is, only about of the variability in the exam- 
ination scores could be attributed to the information contained in 
the five predictor variables (i.e, knowledge of group membership). 
Given five MSU students entering their second Natural Science ■ 
course; three who had taken differsnt BSCS courses in high school; 
another who had a non-BSCS biology course in high school; and a 
fifth who had no biology in high school, we would predict their 
scores on the BSCS Comprehensive Final Examination as follows: 



Predicted Score on BSCS 
Group Student Is In Gc.^prehenslve Final Examination 



I BSCS Green 24 

II BSCS Blue 26 

III BSCS Yellow 25 

IV Other Biology 24. 

V No Biology 21 



On the other hand, an analysis of variance test among the 
five groups produced an F value of 9*69 which is significant 
beyond the ,01 level of significance with 4 and 7^42 degrees of 
freedom. See Table IV. 

TABLE IV 

Analysis of Variance for Five High School Biology 
Experience Groups 

Sum of Degrees of Mean 

Source Squares Freedom Square F 

Between Groups 961.3 ^ 2^4-0,3 9.69 

Error im08.5 7^2 2^.8 

Total 19369.8 7/46 



Conclusion 

Whether the rather small predicted differences or the statis- 
tically significant variance test has more meaning for science 
educators is a judgmental matter. The authors venture to suggest 
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that score prediction via multiple correlation iriay be more jiean- 
ingful than the variance test which depends on the size of the 
sample or population as well as score differences for its signif- 
icance. 

Regardless of one's position on the statistical approach 
another question is bound to arise. Why didri*t the various high 
school biology experiences — including no biology course experience 
at all-- produce greater differences in mean scores on the 3S0F. 
Comprehensive Examination? Does the answer lie in the ■.xamination 
or in the effectiveness of the high school bioln^y courses? 

Synopsis 

Five groups of college students, each of whichi had undergone 
a different high school biology experience, were tested with the 
BSCS Comprehensive Final Examination to obtain data on the lasting 
effects of the BSCS biology courses. The analysis of variance 
approach indicated highly significant differences among the five- 
groups. However, examination of the five means shows that the 
differences are not great enough to have clear educational mt^^i^ing. 
The predicted scores raise questions about the effectiveness of 
either the BSCS courses, the BSCS examination, or both. 



